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Reservation of Copyright 

A portion of the disclosure of this patent document contains material to which a 
claim of copyright protection is made. The copyright owner has no objection to the 
20 facsimile reproduction by anyone of the patent document or the patent disclosure as it 
appears in the Patent and Trademark Office patent file or records, but reserves all other 
rights whatsoever. 

Field of the Invention 

25 The present invention relates to the field of computer user interface design, and in 

particular to an improved user interface for searching for items in a hierarchy of palette 
windows and for incorporating located items into programs. 

Description of the Related Art 

30 A primary goal of a graphical user interface (GUI) is to provide the user the 

maximum amount of intuitiveness, familiarity and flexibility in navigating among the 
components of the GUI. Some GUIs include one or more palette windows which each 
contain a plurality of items that may be selected. For example, a user may select one or 
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more items in a palette window for use in a user interface being created, for inclusion in a 
computer program being created, or for other purposes. Some GUIs also include a 
hierarchy of palette windows, wherein a palette window may include a palette window 
selection item that, when selected, displays a lower palette window ("child palette 
5 window") in the hierarchy. A user may select a palette window selection item in a palette 
window to view a palette window lower in the hierarchy. 

As one example, National Instruments' Lab VIEW graphical programming system 
includes a hierarchy of palette windows for enabling a user to select front panel controls 
and indicators for inclusion in a front panel or user interface being created. Similarly, the 

10 Lab VIEW system also includes a hierarchy of palette windows for enabling a user to 
select nodes for inclusion in a graphical program block diagram being created. 

Prior art methods of accessing a hierarchy of palette windows for use in selecting 
or adding items have generally relied on window technology that displays multi-tiered, 
hierarchical windows, i.e., top level, level 1, level 2, level 3 windows, sub-windows, etc. 

15 Typically, when a lower-level window is selected from a higher-level window, at least a 
portion of the higher-level window remains displayed on the display screen. This method 
may be cumbersome for displaying windows for adding content items several levels deep 
in the hierarchy. In addition, there has been no mechanism provided for enabling a user 
to browse a hierarchy of palette windows in a browser-based fashion. 

20 

Figures 4A-4C illustrate a prior art method for accessing a hierarchy of palette 
windows. Figures 4A-4C illustrate a prior art example of a hierarchy of palette windows 
from the Lab VIEW graphical programming environment. Program elements, including 
user interface elements such as controls and indicators (e.g. ActiveX controls, buttons, 
25 switches, graphs, gauges, etc.), may be added to a software application under 
development by using the exemplary palette windows 100 as illustrated in Figure 4A-4C. 
Palette windows 100 as illustrated in Figure 4 A may include one or more items which 
may include palette window selection items 108 (for example, graph palette window 
selection item 108 A of Figure 4A), and palette items. Exemplary palette items include 
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program elements 112 (for example, user interface element 1 12A of Figure 4B), or utility 
items 110 (for example, utility item 11 OA of Figure 4 A). Each item may include a 
graphical or textual indication of the type of item it is, and may include graphical and/or 
textual indications of the palette window, program element, etc. that it represents. 
5 Upon selecting palette window selection item 108 A of palette window 100 A, for 

example, by clicking or double-clicking the item, a second palette window 100B is 
displayed as illustrated in Figure 4B. In this example, palette window 100A may be 
described as a parent of palette window 100B, and palette window 100B as a child of 
palette window 100A. Palette window 100B may partially cover or overlap palette 
10 window 100A, which remains displayed. In this example, items in palette window 100B 
may be related to adding graph functionality to a program currently being created or 
modified. 

Upon selecting palette window selection item 108B of palette window 100B, a 
'■O third palette window 100C is displayed as illustrated in Figure 4C. In this example, 

15 palette window 100B may be described as a parent of palette window 100C, and palette 
window 100C as a child of palette window 100B. In this example, items in palette 
window 100C may be related to adding picture graphs to a program currently being 
created or modified. In this example, user interface element 1 12B may be added to a user 1 
interface window in a program currently being created or modified, for example, by 
20 dragging and dropping the item on the user interface window. Palette window 100C may 
□ also include one or more palette window selection items 108, for example, item 108C, 

^ that, when selected, may display further child palette windows 100 of palette window 

100C. Note that previously opened palette windows 100 in the hierarchy remain 
displayed when a child palette window of a current palette window is opened. Also, by 
25 selecting other palette window selection items 108 on one of the palette windows 100, 
other branches of the hierarchy of palette windows may be displayed. 

Prior art methods also do not provide for easil y locating a particular item amon g a 
hiera rchy of palette w indows. For larger programs, the hierarchy of palette windows may 
include several hundred items. The prior art methods may be inadequate to allow the user 
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to search through the items for a specific keyword or item name and to navigate to a 
palette window including a desired item. The prior art methods also may be inadequate 
in allowing the user to incorporate located items directly into a program being edited in 
the graphical user interface. Therefore, it is desirable to provide an improved method or 
methods for searching for items in a hierarchy of palette windows in a graphical user 
interface and for allowing located items to be incorporated directly into programs. 
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Summary of the Invention 

One embodiment of the present invention provides a system and method for 
presenting a graphical user interface (GUI) having one or more hierarchies of palette 
5 windows, wherein the GUI includes an improved navigation interface for the palette 
windows. As used herein, a palette window may include the notion of a window (e.g. 
dialog window) displayed by a program which may include one or more items from 
which a user may select. A palette window may include palette items that may be 
selected by a user to add some functionality, capability or element to a program. A 
10 palette window may also include one or more palette window selection items for 
selecting child palette windows in the hierarchy. The palette windows in the hierarchy 
preferably include an improved navigation interface for navigating among windows in 
the hierarchy. 

Embodiments of the present invention may be used in any of various types of 
15 programs or applications which use a hierarchy (or hierarchies) of palette windows. One 
example where the invention may be used is a hierarchy of palette windows that include 
user interface elements that may be selected for inclusion in a graphical user interface 
being created. Another example where the invention may be used is a hierarchy of 
palette windows that include nodes that may be selected for inclusion in a graphical 
20 program being created. Thus example applications that may use hierarchies of palette 
windows as disclosed herein include, but are not limited to, programs for creating a 
graphical user interface and programs for creating a graphical program. 

In one embodiment, a palette window in the hierarchy of palette windows may be 
displayed or opened. In one embodiment the user may directly open a palette window 
25 through the application's user interface, such as by selecting a menu item. The palette 
window may also be automatically opened when the user performs another function, such 
as opening a window to create something that uses palette items contained in the 
hierarchy of palette windows. For example, in creation of a GUI, when the user opens a 
blank GUI window to begin creating the GUI, a parent palette window in the hierarchy of 
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palette windows may be displayed. As another example, in creation of a block diagram 
of a graphical program, when the user opens a blank block diagram window to begin 
creating the block diagram, the parent palette window in the hierarchy of palette windows 
may be displayed. 

5 Palette windows may include various items, including palette items and palette 

window selection items. Palette items may be selectable from a palette window to 
perform various program functions or may be selectable for inclusion in something being 
created. As noted above, palette window selection items may be selected to display child 
palette windows in the hierarchy. Some palette windows in a hierarchy may comprise 

10 only palette window selection items. Other palette windows (e.g. the lowest palette 
windows in the hierarchy) may comprise only palette items and not include any palette 
window selection items. Other windows may comprise a combination of palette window 
selection items and other types of items. For example, in one embodiment of a graphical 
programming application, palette windows may include palette window selection items 

15 and may also include palette items that comprise selectable program elements such as 
user interface elements and/or function nodes. The user interface elements or program 
elements may be selected and added to user interface or block diagram windows of a 
program being created or edited. Unlike the palette items, the palette window selection 
items are not added to user interface or block diagram windows when selected, but rather 

20 cause the display of lower level or child palette windows. 

In one embodiment, palette windows in the hierarchy may include one or more 
navigation items for navigating among the hierarchy of palette windows. In one 
embodiment, the navigation items may be comprised in a navigation toolbar. In one 
embodiment, the navigation items may include one or more of a back navigation item, a 

25 forward navigation item, and an up navigation item. The navigation items may resemble 
"back" and "forward" arrows in a convention web browser. Thus the navigation items 
may present a browser type interface for navigating among the hierarchy of palette 
windows, similar to a web browser. 
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In one embodiment, a mechanism for searching for palette windows and/or palette 
window content (e.g. palette items such as program elements and palette window 
selection items) may be provided. In one embodiment, a search window may be opened 
from any of the palette windows in the hierarchy. The search window may provide an 
5 interface to allow the user to search for and locate palette windows and/or palette window 
content in the hierarchy. From the search window, the user may directly open located 
palette windows in the hierarchy. In embodiments including more than one hierarchy of 
palette windows, the search mechanism may allow a user to navigate from one hierarchy 
to another. For example, the user may open the search window from a first palette 
10 window in a first hierarchy, search for and locate a second palette window in a second 
hierarchy, and open the second palette window. 

In one embodiment, palette items may be selectable from the search window to 
q perform various program functions or may be selectable for inclusion in something being 

!~ created, for example, a program in a graphical programming environment. A search 

15 window may be displayed on a computer display on which a program is being edited in 
=p the graphical user interface. A user may enter search criteria into the search window. 

% The system may then search for and display located items indicated by the search criteria. 

These located items may include one or more items related to program elements that may 
:fi be incorporated in a program being edited to add functionality to the program. The user 

20 may then select one or more located program elements and incorporate the one or more 
program elements in one or more windows of the program being edited. In one 
embodiment, a program element may be incorporated into the program by selecting the 
item and "dragging and dropping" the item on a window of the program. Other methods 
of incorporating items into programs may be used. Thus, the search results displayed in 
25 the search window may include program elements that can be selected and incorporated 
directly from the search window into a window of the program being edited. 

One embodiment of the invention may thus provide a hierarchy of palette 
windows that may be navigated in a manner similar to a web browser, wherein at most 
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one palette window in a hierarchy is displayed at one time, and navigation items may 
provide a web browser type interface. The navigation interface described herein also 
provides improved navigation features over conventional web browsers, including 
improved search capabilities and improved browsing among and between hierarchies of 
panels. 
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Brief Description of the Drawings 

A better understanding of the present invention can be obtained when the 
following detailed description of various embodiments is considered in conjunction with 
5 the following drawings, in which: 

Figures 1A and IB illustrate exemplary instrumentation and industrial automation 
systems; 

Figure 2 illustrates a computer system block diagram according to one embodiment; 
10 Figure 3 is a block diagram illustrating the relationship of portions of the 

instrumentation and industrial automation systems according to one embodiment; 

Figures 4A-4C illustrate a prior art method for navigating among palette 
windows; 

Figures 5A-5E illustrate a method for navigating among a hierarchy of palette 
15 windows with graphical palette window selection items according to one embodiment; 

Figures 6A-6C illustrate a method for navigating among a hierarchy of palette 
windows with textual palette window selection items according to one embodiment; 

Figures 7A-7D illustrate a search window for locating palette windows in a 
hierarchy of palette windows according to one embodiment; 
20 Figures 8A and 8B illustrate exemplary palette windows with several navigation 

items for navigating among a hierarchy of palette windows according to one 
embodiment; 

Figures 9A-9C further illustrate exemplary palette windows with several 
navigation items for navigating among a hierarchy of palette windows according to one 
25 embodiment; and 

Figure 10 illustrates a hierarchical organization of several palette windows 
according to one embodiment; 

Figure 11 illustrates incorporating a located program element from a search 
window into a window of a program being edited according to one embodiment; and 
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Figure 12 is a flowchart of a method of searching for, locating and incorporating 
program elements according to one embodiment. 

While the invention is susceptible to various modifications and alternative forms, 
specific embodiments thereof are shown by way of example in the drawings and will 
herein be described in detail. It should be understood, however, that the drawings and 
detailed description thereto are not intended to limit the invention to the particular form 
disclosed, but on the contrary, the intention is to cover all modifications, equivalents, and 
alternatives falling within the spirit and scope of the present invention as defined by the 
appended claims. Note, the headings are for organizational purposes only and are not 
meant to be used to limit or interpret the description or claims. 
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Detailed Description of Several Embodiments 

Embodiments of the present invention may be used in any of various types of 
programs or applications that use one or more hierarchies of palette windows to provide a 
5 user interface for selecting among various features or functions of the program or 
application. Embodiments of the invention may be used in an operating system, or in 
application programs. One exemplary application that may use a hierarchy (or 
hierarchies) of palette windows is an application for creating a graphical user interface 
(GUI). For example, the palette windows may include different user interface elements 
10 that may be selected for inclusion in the GUI being created. As another example, the 
hierarchy of palette windows may include different application programs or functions 
that may be selected. For example, an operating system may include one or more 
hierarchies of palette windows for selecting programs or functions within the operating 
system. 

15 Another example application that may use a hierarchy (or hierarchies) of palette 

windows is a graphical programming development application. A graphical 
programming development application provides a graphical user interface (GUI) that 
enables users of the application to graphically create and/or edit graphical computer 
programs. A graphical program may include a block diagram and may optionally include 

20 a user interface. In this example, one hierarchy of palette windows may include nodes 
that may be selected for inclusion in the block diagram, and a second hierarchy of palette 
windows may include user interface elements that may be selected for inclusion in the 
user interface of the graphical program. 

An example of a graphical programming environment is National Instruments' 

25 Lab VIEW, which provides a graphical user interface that allows the user to create and/or 
edit graphical programs. Lab VIEW includes functionality targeted toward creation of 
graphical programs, referred to as virtual instruments (Vis), for instrumentation and 
automation applications. The following describes an exemplary embodiment of the 
present invention used in a Lab VIEW graphical programming development system. Thus 
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the exemplary systems shown below are instrumentation and automation systems. Also, 
many of the screen shots used to illustrate the embodiments are representative of 
graphical programming environments similar to the Lab VIEW graphical programming 
environment. It is noted, however, that embodiments of the present invention may be 
5 applied to any computer-executable program that uses one or more hierarchies of palette 
windows. Also, embodiments of the present invention may be used in any of various 
applications, and are not limited to instrumentation and automation applications. 

10 Figures 1 A and IB - Instrumentation and Industrial Automation Systems 

Figures 1A and IB illustrate exemplary systems which may utilize software 
according to one embodiment of the invention. Figures 1A and IB illustrate systems 
targeted for instrumentation, industrial automation, or other purposes. 

Figure 1A illustrates an instrumentation control system 100. The system 100 

15 comprises a host computer 102, which connects to one or more instruments. The host 
computer 102 may comprise a CPU, a display, memory, and one or more input devices such 
as a mouse or keyboard as shown. The computer 102 may connect through the one or more 
instruments to analyze, measure, or control a unit under test (UUT) or process 150. The 
host computer 102 may store computer programs for creating or editing a graphical 

20 program, such as a graphical program, which interacts with or controls the one or more 
instruments. 

The one or more instruments may include a GPIB instrument 112 and associated 
GPIB interface card 122, a data acquisition board 114 and associated signal conditioning 
circuitry 124, a VXI instrument 116, a PXI instrument 118, a video device 132 and 
25 associated image acquisition card 134, a motion control device 136 and associated motion 
control interface card 138, and/or one or more computer based instrument cards 142, among 
other types of devices. 

The instruments may be coupled to the unit under test (UUT) or process 150, or 
may be coupled to receive field signals, typically generated by transducers. The system 
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100 may be used in a data acquisition and control application, in a test and measurement 
application, a process control application, or a man-machine interface application. 

Figure IB illustrates an exemplary industrial automation system 160. The industrial 
5 automation system 160 is similar to the instrumentation or test and measurement system 100 
shown in Figure 1A. Elements, which are similar or identical to elements in Figure 1A, 
have the same reference numerals for convenience. The system 160 comprises a computer 
102, which connects to one or more devices or instruments. The computer 102 may 
comprise a CPU, a display screen, memory, and one or more input devices such as a mouse 

10 or keyboard as shown. The computer 102 may connect through the one or more devices to a 
process or device 150 to perform an automation function, such as MMI (Man Machine 
Interface), SCADA (Supervisory Control and Data Acquisition), portable or distributed data 
acquisition, process control, advanced analysis, or other control. In Figure IB, the computer 
102 may store computer programs for creating or editing a graphical program, such, such as 

15 a graphical program that is involved with the automation function performed by the 
automation system 160. 

The one or more devices may include a data acquisition board 114 and associated 
signal conditioning circuitry 124, a PXI instrument 118, a video device 132 and associated 
image acquisition card 134, a motion control device 136 and associated motion control 

20 interface card 138, a fieldbus device 170 and associated fieldbus interface card 172, a PLC 
(Programmable Logic Controller) 176, a serial instrument 182 and associated serial interface 
card 184, or a distributed data acquisition system, such as the Fieldpoint system available 
from National Instruments, among other types of devices. The devices may be coupled to 
the device or process 150. 

25 In typical instrumentation and/or industrial automation systems a device will not be 

present of each interface type, and in fact many systems may only have one or more devices 
of a single interface type. 
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Referring again to Figures 1A and IB, the computer system 102 preferably 
includes a memory medium on which one or more computer programs are stored. The 
one or more programs may include user interfaces implementing one or more hierarchies 
of palette windows. The one or more hierarchies of palette windows may include an 
5 improved navigation interface according to one embodiment of the present invention. 
The improved navigation interface may provide browser-type navigation items as 
described herein that may provide an interface similar to an Internet web browser. The 
improved navigation interface may provide that at most one palette window in a 
hierarchy is displayed at one time, and may include improved search capabilities, among 

10 other features described herein. 

The term "memory medium" is intended to include an installation medium, e.g., a 
CD-ROM, floppy disks 104, or tape device, a computer system memory or random access 
memory (RAM) such as DRAM, SRAM, EDO RAM, Rambus RAM, etc., or a non-volatile 
memory such as a magnetic media, e.g., a hard drive, or optical storage. The memory 

15 medium may comprise other types of memory as well, or combinations thereof. 

In addition, the memory medium may be located in a first computer in which the 
programs are executed, or may be located in a second different computer, which connects to 
the first computer over a network, such as the Internet. In the latter instance, the second 
computer provides the program instructions to the first computer for execution. Also, the 

20 computer system 102 may take various forms, including a personal computer system, 
mainframe computer system, workstation, network appliance, Internet appliance, personal 
digital assistant (PDA), television system or other device. In general, the term "computer 
system" can be broadly defined to encompass any device having at least one processor, 
which executes instructions from a memory medium. 

25 

As noted above, in the exemplary embodiment described herein, the one or more 
hierarchies of palette windows include palette items used in creating a graphical program. 
The graphical program that is created may be designed for data acquisition/generation, 
analysis, and/or display, and for controlling or modeling instrumentation or industrial 
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automation hardware. An exemplary graphical programming development system that 
may be used to develop the graphical program is the National Instruments Lab VIEW 
graphical programming application. LabVIEW provides specialized support for 
developers of instrumentation and industrial automation applications. 
5 However, it is noted that the present invention may be used in a plethora of 

applications and is not limited to graphical programming applications including 
instrumentation or industrial automation applications. In other words, Figures 1A and IB 
are exemplary only, and embodiments of the present invention may be used in any of 
various types of systems or applications that use one or more hierarchies of palette windows. 

10 

Figure 2 - Computer System Block Diagram 

Figure 2 is a block diagram of the exemplary computer system illustrated in Figures 
1 A and IB. It is noted that any type of computer system configuration or architecture can be 
used as desired, and Figure 2 illustrates a representative PC embodiment. The elements of a 
15 computer not necessary to understand the present invention have been omitted for 
simplicity. 

The computer 102 includes at least one central processing unit or CPU 160 that is 
coupled to a processor or host bus 162. The CPU 160 may be any of various types, 
including an x86 processor, e.g., a Pentium class, a PowerPC processor, a CPU from the 

20 SPARC family of RISC processors, as well as others. Main memory 166 is coupled to 
the host bus 162 by means of memory controller 164. 

The main memory 166 stores computer programs according to one embodiment. 
More particularly, in this embodiment, the main memory 166 may store a graphical 
programming development system which includes a user interface having one or more 

25 hierarchies of palette windows. The main memory 166 also stores operating system 
software as well as other software for operation of the computer system, as well known to 
those skilled in the art. The computer programs of one or more embodiments will be 
discussed in more detail below. 
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The host bus 162 may be coupled to an expansion or input/output bus 170 by 
means of a bus controller 168 or bus bridge logic. The expansion bus 170 of this 
embodiment may be the PCI (Peripheral Component Interconnect) expansion bus, 
although other bus types can be used. The expansion bus 170 includes slots for various 
5 devices such as the data acquisition board 1 14 (of Figure 2 A), a GPIB interface card 122 
which provides a GPIB bus interface to the GPIB instrument 112 (of Figure 2 A), and a 
VXI or MXI bus card 186 coupled to the VXI chassis 1 16 for receiving VXI instruments. 
The computer 102 further comprises a video display subsystem 180 and hard drive 182 
coupled to the expansion bus 170. 

10 

Figure 3 - Graphical Programming Environment 

Figure 3 is a block diagram illustrating one embodiment of the relationship of 
portions of an exemplary instrumentation control system 100 (of Figure 1A) or the 
automation system 160 (Figure IB). The elements shown in Figure 3 (with the exception 
15 of the instrument hardware 54) may be software elements, which are executed on the 
computer 102 (of Figures 1A or IB). The exemplary system described herein may be 
used to create a graphical program, or graphical program portion, to provide an interface 
to one or more instruments connected to the computer system on which the program is 
executed. 

20 The block diagram editor 64 is operable to create a block diagram or VI 50, and 

the front panel editor 62 is operable to create a front panel or user interface. A graphical 
program comprises the block diagram and may also comprise the front panel. The block 
diagram editor 64 communicates with the graphical program nodes 66, which in turn 
communicate with the graphical programming development system 68. In a similar 

25 manner, the front panel editor 62 communicates with the front panel controls 74, which in 
turn communicate with the graphical programming development system 68. 

A programmer may employ the front panel editor 62, the block diagram editor 64, 
and a connector pane/icon editor 72 of a graphical programming system to produce a 
graphical program. In the exemplary instrumentation application, the graphical program 
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may be referred to as a virtual instrument (VI) 50. The VI 50 may include one or more 
nodes or blocks that may be connected or coupled together as specified by the user. 

The graphical programming environment comprises one or more graphical 
program nodes 66 that may be selected for inclusion in a graphical program block 
5 diagram. The block diagram editor 64 may include one or more palette windows which 
include nodes 66 (or icons representing the nodes) that may be selected for inclusion in 
the block diagram being created. The block diagram editor 64 may also generate 
executable instructions, i.e., machine language instructions, in response to the VI 50. The 
VI 50 developed by the programmer is executed by an execution subsystem 56 of the 
10 graphical programming environment to control an instrument 54. The instrument 54 is 
illustrative of instruments such as those of Figure 1. 

Referring again to Figure 3, the graphical programming environment further 
q comprises one or more front panel controls or graphical user interface (GUI) elements 74. 

% The front panel editor 62 is operable to generate a front panel or GUI using one or more 

=fl 15 of the controls 74. The front panel editor 62 may include one or more palette windows 

15 that include user interface elements or controls 74 (icons representing the controls) that 

;fj may be selected for inclusion in the front panel or user interface being created. 

5aar 

The graphical programming environment may further comprise a connector 
% pane/icon editor 72 for forming VFs into sub VPs, i.e., a VI 50 that may be used as a 

^ 20 graphical programming element in another VI. The reader is referred to U.S. Patent 

Q Number 5,301,336 for more information about the sub VFs and the icon editor 72. 

1 The execution subsystem 56 executes the executable instructions constructed 

from a block diagram and/or front panel of the VI 50. For more information about the 
graphical programming development system, please see U.S. Patent Number 5,481,741, 
25 which is hereby incorporated by reference as though fully and completely set forth 
herein. 

Figures 5 A- 10 - Improved Palette Window Navigation 

Various types of computer programs may include one or more hierarchies of 
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palette windows comprising an embodiment of the invention as described herein. For 
example, a software program may be launched to perform a task. The software program 
may display palette windows from a hierarchy of palette windows that provide a user 
interface to various aspects of the program. In one embodiment, the software program 
5 may be a graphical programming application that allows the user to graphically create 
and/or edit computer-executable programs. Figures 5 A- 10 illustrate an exemplary 
graphical programming environment in which the various aspects of the present invention 
may be implemented. It is noted, however, that the various aspects of the present 
invention may be applied to any computer-executable program or application that uses 
10 one or more hierarchies of palette windows. 

In one embodiment, one or more palette windows may be opened automatically in 
response to a program action, such as the opening of a window related to the elements in 
the palette windows. For example, in the exemplary graphical programming 

15 environment, opening a user interface window and/or a function block diagram window 
may result in one or more palette windows being automatically opened. Alternatively, 
the user may open palette windows through an application's user interface, for example, 
by choosing a menu item to select and/or display one or more palette windows. 

An exemplary graphical programming application may open one or more 

20 windows, which may include user interface windows and/or block diagram windows, 
upon launch of the application. Alternatively, user interface windows and/or block 
diagram windows may be opened by the user subsequent to the launching of the 
application using the application's user interface. A user may add, delete or modify 
various user interface elements in a user interface window. User interface elements, e.g. 

25 controls and indicators, may represent or display various inputs and outputs of the 
graphical program, and/or may represent interfaces to items, for example, device 
interfaces in a virtual instrument (VI) program. The user interface window may also 
include user interface elements that, when selected, open or display one or more other 
user interface windows for accessing other aspects of the graphical program. 
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A block diagram window may include one or more function nodes or program 
elements, such as terminals, that may correspond to user interface elements in a user 
interface window and nodes that embody a function. The nodes or function elements 
may represent executable functions or executable software modules. The nodes or 
5 function elements may be interconnected or "wired up" to visually indicate functionality 
of the graphical program, wherein the nodes perform various operations during execution 
of the graphical program. 

A palette window may include palette items (also called "program elements") and 

10 palette window selection items. 

Palette items may be selectable to perform various program functions, e.g., palette 
items may be selected to display the corresponding icon in a window or may be selected 
to perform a desired function. Palette items may be represented graphically or as text 
items, for use in constructing windows, for example, graphical user interface windows 

15 and block diagram windows. In one embodiment, a palette item may be placed on a 
window by selecting the item in a palette window, and "dragging and dropping" the item 
on the window. Other methods of adding items to windows may be used. For example, 
in one embodiment, a user may select an item in a palette window, and a menu choice 
may then be selected to add the selected item to a window. 

20 In a hierarchy of palette windows used in creating a graphical user interface in 

the graphical user interface window, the palette items in the palette windows may include 
user interface elements to be displayed in the graphical user interface window. In one 
embodiment, user interface elements may be classified into two main groups: control 
(input) items, and indicator (output) items. Some items may support both input and 

25 output. Examples of control and indicator items that may be included in a palette 
window include, but are not limited to: Boolean interface items such as switches and 
buttons; 2- and 3-dimensional graphs and charts; textual items such as text fields, lists 
and tables; and numeric interface items such as gauges, digital controls, analog controls 
such as knobs, etc. 
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In a hierarchy of palette windows used in creating a block diagram in the block 
diagram window, the palette items in the palette windows may include functions nodes 
(also called function elements or primitives) to be displayed in the block diagram 
window. Examples of types of function elements may include, but are not limited to: 
5 program structures such as for and while loops, case statements, and global or local 
variables; operators such as numeric (addition, multiplication, etc.), comparison (equal to, 
greater than, etc) and logical (AND, OR, XOR, etc) operators; file I/O items; signal or 
waveform processing function elements; complex mathematical function elements; 
instrument driver items; communications items; and graphical or sound items. 

10 Some embodiments may include a plurality of hierarchies of palette windows. 

For example, in the exemplary graphical programming environment, a first hierarchy 
may include user interface elements for use in creating a user interface, and a second 
hierarchy may include function elements or nodes for use in creating a block diagram. 

Individual palette windows may include related groups of elements. For example, 

15 in the exemplary graphical programming environment, in the first hierarchy a first palette 
window may include graph and chart user interface elements, a second palette window 
may include Boolean user interface elements, and a third palette window may include 
digital user interface elements, etc. In a similar manner, in the second hierarchy a first 
palette window may include numeric operator function elements, a second palette 

20 window may include signal processing function elements, and a third palette window 
may include Boolean operator elements, etc. 

Palette window selection items in a palette window may be selected to display a 
lower level palette window in the hierarchy. Thus, palette window selection items are 
25 one mechanism for navigating among the hierarchy of palette windows. In one 
embodiment, a first palette window may include one or more palette window selection 
items that, when selected, open a second palette window that may be referred to as a child 
of the first (parent) palette window. When the child palette window is opened, the parent 



Atty.Dkt.No.; 5150-43101 



Page 20 



Conley, Rose & Tayon, P.C. 



(current) palette window may be automatically closed. Thus, in one embodiment, at most 
one palette window in a hierarchy is displayed at one time. 

Thus, unlike palette items or program elements that may be selected to perform a 
function, such as being selected to be added to a window, the palette window selection 
5 items are selected primarily (or only) for the purpose of displaying lower level palette 
windows in the hierarchy. 

Some palette windows in a hierarchy may comprise only palette window selection 
items. For example, the "root" or top-level palette window may include only palette 
window selection items for selecting other palette windows to be displayed. Other palette 

10 windows (e.g. the lowest palette windows in the hierarchy) may comprise only palette 
items and may not include any palette window selection items. Yet other windows may 
comprise a combination of palette window selection items and palette items. For 
example, in one embodiment of a graphical programming application, palette windows 
may include palette window selection items and palette items representing selectable 

15 program elements such as user interface elements and/or function elements. 

In one embodiment, the palette window selection items may include an indicator 
to distinguish these selection items from palette items or other items in the palette 
window. For example, a selection item may include a graphical indicator, such as an 
arrow, that identifies the item as a palette window selection item that references a lower 

20 level palette window. 

Palette Window Navigation Items 

In one embodiment of the invention, palette windows in a hierarchy may include 
one or more navigation items for navigating among the hierarchy of palette windows. In 
25 one embodiment, the navigation items may be comprised in a navigation toolbar. The 
navigation toolbar may be displayed at the top of each palette window. In one 
embodiment, the navigation items may include one or more of a back navigation item, a 
forward navigation item, and an up navigation item. In one embodiment, the back 
navigation item may be represented as a back arrow, the forward navigation item may be 
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represented as a forward arrow, and the up navigation item may be represented as an up 
arrow. 

The back navigation item may be operable when selected to open or display a 
most recently previously displayed palette window in a backward direction. The forward 
navigation item may be operable when selected to open or display a most recently 
previously displayed palette window in a forward direction. The up navigation item may 
be operable when selected to open or display a parent palette window of the current 
palette window, regardless of the most recently previously displayed palette window. 
Various other navigation items may be included which perform other types of navigation. 

The navigation items may be used in navigating to previously displayed (or non- 
previously displayed) palette windows and other windows in the program. In one 
embodiment, a navigation item may be used to list and optionally select from the palette 
windows that are higher in the hierarchy of palette windows than the currently displayed 
palette window. In another embodiment, a navigation item may be used to list and 
optionally select from the palette windows that are lower in the hierarchy of palette 
windows than the currently displayed palette window. 

When a palette window is opened or displayed using one of the navigation items, 
the current palette window is closed or no longer displayed. Thus, in one embodiment, at 
most one palette window in a hierarchy is displayed at one time. For example, when a 
previously displayed palette window, or one higher in the hierarchy, is opened using one 
of the navigation items, the current palette window is closed or no longer displayed. 

In one embodiment, when there is no previously displayed palette window from 
the current palette window, or when there is no palette window higher (or lower) in the 
hierarchy than the current window, one or more of the navigation items may be disabled. 

In one embodiment, a mechanism for searching for palette windows and/or palette 
window content (e.g. program elements and palette window selection items) may be 
provided. In one embodiment, a search window may be opened from any palette window 
in the hierarchy. The search window may provide an interface to allow the user to search 
for and locate palette windows and/or palette window content in the hierarchy of palette 
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windows. From the search window, the user may directly open located palette windows 
in the hierarchy. The various navigation items may still operate after a search to return to 
the previously displayed palette window in which the search originated. In one 
embodiment, the search window may also include one or more navigation items operable 
5 when selected to open or display previously displayed palette windows from the search 
window. 

Figures 5 A-5E - Navigating among a hierarchy of palette windows 

Figures 5A-5E illustrate an exemplary graphical user interface (of a graphical 

10 programming environment) used to illustrate various embodiments of a method for 
navigating among a hierarchy of palette windows using graphical palette window 
selection items. It is noted, however, that the various aspects of the present invention 
illustrated in this example may be applied to any computer-executable program or 
application that uses one or more hierarchies of palette windows. 

15 In the exemplary graphical programming environment, program elements (also 

called "palette items") may be added to windows (e.g. block diagram or user interface 
windows of a program currently being created or modified in the exemplary graphical 
programming application) from the hierarchies of palette windows 200 as illustrated in 
Figure 5A-5E. The program elements may be represented as graphical objects in the 

20 palette windows 200. 

Palette windows 200 as illustrated in Figures 5A-5E may include a palette 204 of 
one or more graphical items which may include palette window selection items 208 (for 
example, graph palette window selection item 208A of Figure 5A), program elements 
212 (for example, user interface element 212A of Figure 5C), and utility items 210 (for 

25 example, utility item 21 OA of Figure 5 A for displaying an interface for selecting custom 
controls). Each item may include a graphical or textual indication of the type of item it 
is, and may include graphical and/or textual indications of the palette window, program 
element, etc. that it represents. In the palette windows 200 illustrated in Figures 5A-5E, a 
triangle or arrow at the upper right corner of an item may indicate that the item is a 
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palette window selection item 208, an ellipsis at the bottom of an item may indicate that 
the item is a utility item 210, and the absence of an indicator may indicate that the item is 
a program element 212. Other embodiments may include other types of items. Other 
embodiments may also use other graphical or textual indicators for identifying item types 
5 to users. 

In one embodiment as illustrated in Figure 5B, when a user selects an item, for 
example, by moving cursor 226 over the item, a description of the item may be displayed 
in the palette window. In this example, "Graph" appears above the items in the palette 
204 for selected palette window selection item 208A, indicating that a palette window 

10 associated with item 208A may include one or more items related to adding graph 
functionality to a program. Upon selecting palette window selection item 208 A of palette 
window 200A, for example, by clicking or double-clicking the item, a second palette 
window 200B is displayed as illustrated in Figure 5C, and palette window 200A is 
closed. In this example, palette window 200A may be described as a parent of palette 

15 window 200B, and palette window 200B as a child of palette window 200A. In this 
example, items in palette window 200B may be related to adding graph functionality to a 
program currently being created or modified. 

Upon selecting palette window selection item 208B of palette window 200B as 
illustrated in Figure 5D, a third palette window 200C is displayed as illustrated in Figure 

20 5E, and palette window 200B is closed. In this example, palette window 200B may be 
described as a parent of palette window 200C, and palette window 200C as a child of 
palette window 200B. In this example, items in palette window 200C may be related to 
adding picture graphs to a program currently being created or modified. For example, 
user interface element 212B may be added to a user interface window in a program 

25 currently being created or modified, for example, by dragging and dropping the item on 
the user interface window. Palette window 200C may also include one or more palette 
window selection items 208, for example, item 208C, which display child palette 
windows 200 of palette window 200C when selected. By selecting other palette window 
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selection items 208 on one of the palette windows 200 as illustrated in Figures 5A-5E, 
other branches of the hierarchy of palette windows may be displayed. 

Note that, unlike prior art palette windows, previously opened palette windows 
200 in the hierarchy are not displayed when a child palette window of a current palette 
5 window is displayed. Thus, in the present invention, there is no limitation imposed by 
keeping palette windows open as there is for the palette windows as illustrated in Figures 
4A-4D. This operates to present more of a web browser type interface. 

Palette windows 200 as illustrated in Figures 5A-5E may also include one or more 
10 navigation items for navigating among the hierarchy of palette windows 200. Figure 5A 
illustrates one embodiment of a palette window 200A with several navigation items 
comprised in a navigation toolbar 214. The navigation items in this embodiment may 
q include one or more of a back navigation item 216, a forward navigation item 218, and an 

J™ up navigation item 220. In one embodiment, palette windows 200 may also include a 

*0 15 back navigation menu item 217, a forward navigation menu item 219, and an up 

m navigation menu item 22 1 . 

:i: After using the palette window selection items 208 to display two or more palette 

windows as described above for Figures 5A-5E, the back and forward navigation items 

O 

jji 216 and 218 may be used to navigate to previously displayed palette windows in a 

)*f 20 backward and forward direction. For example, the selection of back navigation item 216 

□ of palette window 200C of Figure 5E causes palette window 200B of Figure 5C (the most 

recently displayed palette window in a backward direction) to be displayed, and palette 
window 200C to be closed. Subsequently selecting back navigation item 216 of palette 
window 200B of Figure 5C causes palette window 200A of Figure 5A (the next 
25 previously displayed palette window in the backward direction) to be displayed and 
palette window 200B to be closed. 

From palette window 200 A, forward navigation item 218 may then be selected to 
display palette window 200B of Figure 5C (the most recently displayed palette window 
in the forward direction) and close palette window 200A. Subsequently selecting 



Atty. Dkt.No.: 5150-43101 



Page 25 



Conley, Rose & Tayon, P.C. 



forward navigation item 218 from palette window 200B of Figure 5C results in palette 
window 200C of Figure 5E (the next palette window in the forward direction) being 
displayed, and palette window 200B being closed. 

After using the palette window selection items 208 to display two or more palette 

5 windows as illustrated in Figures 5A-5E, the back and forward navigation menu items 
217 and 219 may also be used to navigate to previously displayed palette windows in a 
backward and forward direction. Selecting a navigation menu item may result in the 
display of a menu including menu items for one or more previously displayed palette 
windows 200. Selecting a menu item for one of the palette windows 200 from the menu 

10 causes the selected palette window 200 to be displayed and the currently displayed 
palette window 200 to be closed. 

For example, the selection of back navigation menu item 217 of palette window 
200C of Figure 5E may display a menu including menu items for all previously displayed 
palette windows in a backward direction (in this example, palette window 200B of Figure 

15 5C and palette window 200A of Figure 5 A). Selecting the menu item for palette window 
200A from the menu causes palette window 200A to be displayed and palette window 
200C to be closed. Subsequently selecting the forward navigation menu item 219 of 
palette window 200A of Figure 5A may display a menu including menu items for all 
previously displayed palette windows in a forward direction (in this example, palette 

20 window 200B of Figure 5C and palette window 200C of Figure 5E). Selecting the menu 
item for palette window 200B from the menu causes palette window 200B to be 
displayed and palette window 200A to be closed. 

The up navigation item 220 may be used to navigate to palette windows higher in 
the hierarchy of palette windows than the currently displayed palette window. For 

25 example, the selection of up navigation item 220 of palette window 200C of Figure 5E 
causes palette window 200B of Figure 5C (the parent palette window of palette window 
200C) to be displayed, and palette window 200C to be closed. Subsequently selecting up 
navigation item 220 of palette window 200B of Figure 5C causes palette window 200A 
of Figure 5 A (the parent palette window of palette window 200B) to be displayed and 
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palette window 200B to be closed. Note that, in this example, if palette window 200A is 
the root palette window (i.e. has no parent) then selecting up navigation item 220 of 
palette window 200A will have no effect. 

The up navigation menu item 221 may also be used to navigate to palette 
5 windows higher in the hierarchy of palette windows than the currently displayed palette 
window. For example, the selection of up navigation menu item 221 of palette window 
200C of Figure 5E may display a menu including menu items for all palette windows 
higher in the hierarchy than palette window 200C (in this example, palette window 200B 
of Figure 5C and palette window 200A of Figure 5 A). Selecting the menu item for one 
10 of the palette windows 200 from the menu causes the selected palette window 200 to be 
displayed and palette window 200C to be closed. 

In one embodiment, palette windows 200 may also include a search item 222. In 
one embodiment, palette windows 200 may also include an item 224 that, when selected, 
displays a user interface for changing the configuration, display characteristics, etc. of 
palette windows in the hierarchy. In one embodiment, the user interface may allow the 
user to toggle the palette window to display items in palette windows in either textual 
format (as illustrated in Figure 6A), graphical format (as illustrated in Figure 5A) or 
optionally in a combination of graphical and textual. In one embodiment, the user 
interface may also allow palette window selection items 208 to be added to and/or 
removed from palette windows 204, thus providing a method for the user to modify the 
hierarchy of palette windows. 

Figures 6A-6C - Palette windows with text palette window selection items 
25 Figures 6A-6C illustrate an exemplary graphical programming environment used 

to illustrate various embodiments of a method for navigating among a hierarchy of palette 
windows using textual palette window selection items. It is noted, however, that the 
various aspects of the present invention illustrated in this example may be applied to any 
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computer-executable program or application that uses one or more hierarchies of palette 
windows. 

In the exemplary graphical programming environment, program elements may be 
added to windows (e.g. a functional or user interface windows of a program currently 
5 being created or modified) from hierarchy of palette windows 240 with textual palette 
window selection items as illustrated in Figure 6A-6C. The program elements may be 
represented as text objects in the palette windows 240. 

Palette windows 240 as illustrated in Figures 6A-6C may include a list 242 of one 
or more text items including palette window selection text items 244 (for example, graph 

10 palette window selection text item 244 A of Figure 6 A), program elements 248 (for 
example, user interface element 248 A of Figure 6C), and utility items 246 (for example, 
utility item 246 A of Figure 6A). 

In one embodiment as illustrated in Figure 6B, when a user selects a text item 
from the list 242, for example, by moving cursor 226 over the text item, the text item may 

15 be highlighted. In this example, the selected palette window selection text item 244A 
"Graph" is highlighted. Upon selecting palette window selection text item 244A of 
palette window 240A, for example, by clicking or double-clicking the item, a second 
palette window 240B is displayed as illustrated in Figure 6C, and palette window 240A is 
closed. In this example, palette window 240A may be described as a parent of palette 

20 window 240B, and palette window 240B as a child of palette window 240A. 

In this example, items in palette window 240B may be related to adding charts 
and graphs to a program currently being created or modified. For example, user interface 
element 248A may be added to a user interface window in a program currently being 
created or modified, for example, by dragging and dropping the item on the user interface 

25 window. Palette window 240B may also include one or more palette window selection 
text items 244, for example item 244B, which display child palette windows 240 of 
palette window 24B when selected. By selecting other palette window selection text 
items 244 on one of the palette windows 240 as illustrated in Figures 6A-6C, other 
branches of the hierarchy of palette windows may be displayed. 

Atty. Dkt No.: 5 150-43 101 Page 28 Conley, Rose & Tayon, P.C. 



Palette windows 240 as illustrated in Figures 6A-6C may also include one or 
more navigation items for navigating among the hierarchy of palette windows 240. 
Figure 6A illustrates one embodiment of a palette window 240A with several navigation 
5 items comprised in a navigation toolbar 214. The navigation items in this embodiment 
may include back navigation item 216, forward navigation item 218, and up navigation 
item 220. In one embodiment, palette windows 240 may also include back navigation 
menu item 217, forward navigation menu item 219, and up navigation menu item 221 . 

After using the palette window selection items 208 to display two or more palette 

10 windows as described above for Figures 6A-6C, the back and forward navigation items 
216 and 218 may be used to navigate to previously displayed palette windows in a 
backward and forward direction. For example, the selection of back navigation item 216 
of palette window 240B of Figure 6C causes palette window 240A of Figure 6A (the 
most recently displayed palette window in a backward direction) to be displayed, and 

15 palette window 240B to be closed. From palette window 240 A, forward navigation item 
218 may then be selected to display palette window 240B of Figure 6C (the most recently 
displayed palette window in the forward direction) and close palette window 240A. 

After using the palette window selection items 208 to display two or more palette 
windows as illustrated in Figures 6A-6C, the back and forward navigation menu items 

20 217 and 219 may also be used to navigate to previously displayed palette windows in a 
backward and forward direction. Selecting a navigation menu item may result in the 
display of a menu including menu items for one or more previously displayed palette 
windows 240. Selecting a menu item for one of the palette windows 240 from the menu 
causes the selected palette window 240 to be displayed and the currently displayed 

25 palette window 240 to be closed. 

For example, the selection of back navigation menu item 217 of palette window 
240B of Figure 6C may display a menu including menu items for all previously displayed 
palette windows in a backward direction (in this example, palette window 240A of Figure 
6A). Selecting the menu item for palette window 240A from the menu causes palette 
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window 240A to be displayed and palette window 240B to be closed. Subsequently 
selecting the forward navigation menu item 219 of palette window 240 A of Figure 6 A 
may display a menu including menu items for all previously displayed palette windows in 
a forward direction (in this example, palette window 240B of Figure 6C). Selecting the 
5 menu item for palette window 240B from the menu causes palette window 240B to be 
displayed and palette window 240A to be closed. 

The up navigation item 220 may be used to navigate to palette windows higher in 
the hierarchy of palette windows than the currently displayed palette window. For 
example, the selection of up navigation item 220 of palette window 240B of Figure 6C 

10 causes palette window 240 A of Figure 6A (the parent palette window of palette window 
240B) to be displayed, and palette window 240B to be closed. Note that, in this 
example, if palette window 240A is the root palette window (i.e. has no parent) then 
selecting up navigation item 220 of palette window 240A will have no effect. 

The up navigation menu item 221 may also be used to navigate to palette 

15 windows higher in the hierarchy of palette windows than the currently displayed palette 
window. For example, the selection of up navigation menu item 221 of palette window 
240B of Figure 6C may display a menu including menu items for all palette windows 
higher in the hierarchy than palette window 240B (in this example, palette window 240A 
of Figure 6A). Selecting the menu item for palette window 240A from the menu causes 

20 the selected palette window 240A to be displayed and palette window 240B to be closed. 

In one embodiment, palette windows 240 may also include search item 222. In 
one embodiment, palette windows 240 may also include an item 224 that, when selected, 
displays a user interface for changing the configuration, display characteristics, etc. of 
25 palette windows in the hierarchy. In one embodiment, the user interface may allow the 
user to toggle the palette window to display items in the palette windows in either textual 
format (as illustrated in Figure 6A) or graphical format (as illustrated in Figure 5A). In 
one embodiment, the user interface may also allow palette window selection text items 
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244 to be added to and/or removed from list 242, thus providing a method for a user to 
modify the hierarchy of palette windows. 

Figures 7A-7D - A search window for locating palette windows in a hierarchy 

Figures 7A-7D illustrate an exemplary graphical user interface (in a graphical 
programming development environment application) with a search window 300 for 
locating palette windows and palette window content in a hierarchy of palette windows 
according to one embodiment. It is noted, however, that the various aspects of the 
present invention illustrated in this example may be applied to any computer-executable 
program or application that uses one or more hierarchies of palette windows. 

In one embodiment, palette windows such as those illustrated in Figures 5A and 
6A may include a search item 224 that, when selected, displays search window 300. For 
example, a user may select sea rch item 244 from palette window 200A of Figure 5A, 
resulting in search window 300 of Figure 7A being displayed. In one embodiment, the 
palette window from which the search window 300 was selected may be automatically 
closed when the search window 300 opens. 

Search window 300 may also include one or more navigation items for navigating 
among the hierarchy of palette windows. Figure 7A illustrates one embodiment of a 
search window 300 with several navigation items comprised in a navigation toolbar 214. 
The navigation items in this embodiment may include back navigation item 216, forward 
navigation item 218, and up navigation item 220. In one embodiment, search window 
300 may also include back navigation menu item 217, forward navigation menu item 
219, and up navigation menu item 221. 

Search window 300 may also include a search field JJ02 configured to accept user 
input for searching for palette windows and/or palette window content. Search window 
300 may also include a list 306 of text entries or strings that may include palette window 
titles and program element names. In one embodiment, the text entries in list 306 may be 
in alphabetical order. Search window 300 may also include a scroll bar 308 for viewing 
hidden portions of list 306. In one embodiment, if the text entries currently in list 306 are 
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all visible within search window 300, the scroll bar may be hidden or disabled. Search 
window 300 may also include interface items 304 for modifying aspects of searches for 
strings in the list of text entries. In this example, two interface items 304 are shown that 
allow a user to toggle between searching for text entries beginning with a search string 
5 and searching for text entries including a search string. 

Figures 7B-7D illustrate using search window 300 to locate content (e.g. program 
objects) and/or palette windows. In Figure 7B, a user may enter a text string in search 
field 302. In this example, the user may enter the string "Recta" in search field 302, and 
the list 306 of entries is reduced to entries including the entered string. In Figure 7C, the 

10 user may enter the string "Rectangle" in search field 302, and the list 306 is reduced to 
the one entry including the entire entered string. Note that if the user enters a string that 
is not included in any entries in list 306, then the displayed list of entries may be empty. 

The user may select a text entry, e.g. by clicking or double-clicking on a text entry 
in the list 306, to display a palette window associated with the entry. For example, in 

15 Figure 7C, the user may select (e.g. click on) the entry "Rectangle.ctl", and the 
"Datatypes" palette window 200D illustrated in Figure 7D may be displayed. Palette 
window 200D includes the program element "Rectangle.ctl" 212C corresponding with 
the "Rectangle.ctl" text entry in list 306 of search window 300 selected by the user. In 
one embodiment, if the palette windows are currently in text display mode, the items in 

20 the "Datatypes" palette window are displayed in text format similar to the items in the 
palette window 240A as illustrated in Figure 6A. 

In one embodiment, the search window 300 may be closed when a palette window 
is displayed. Alternatively, the user may open a palette window from a list 306 including 
morejhan one text entry in search window 300 (for example, search window 300 as 

25 shown in Figures 7A and 7B) by selecting a text entry associated with the palette window 
from the list 306, for example, by moving the cursor over the item and clicking or 
double-clicking it. 

In one embodiment, list 306 of search window 300 may include one or more 
palette items. Palette items displayed in list 306, similar to palette items in palette 
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windows, may be selectable to perform various program functions, e.g., palette items 
may be selected to display the corresponding icon in a window being constructed, for 
example, graphical user interface windows and block diagram windows, or may be 
selected to perform a desired function. In one embodiment, a palette item may be placed 
5 on a window by selecting the item in list 306 and "dragging and dropping" the item on 
the window. Other methods of adding items from list 306 to windows may be used. For 
example, in one embodiment, a user may select an item in list 306 and a menu choice 
may then be selected to add the selected item to a window. Thus, the search results 
displayed in the search window may include palette items (e.g., icons) that can be 
10 selected, such as through a drag and drop method, directly from the search window, in a 
similar manner to which the palette item may be selected from its respective palette 
window. 

Figures 8 A and 8B - An exemplary palette window with navigation items 
15 Figures 8 A and 8B illustrate a palette window in an exemplary graphical 

programming environment with navigation items for navigating among a hierarchy or 
hierarchies of palette windows according to one embodiment. It is noted, however, that 
the various aspects of the present invention illustrated in this example may be applied to 
any computer-executable program or application that uses a hierarchy or hierarchies of 
20 palette windows. 

Palette windows 200D as illustrated in Figures 8A-8B may include one or more 
navigation items for navigating among the hierarchy of palette windows. The navigation 
items may be comprised in a navigation toolbar 214. The navigation items in this 
embodiment may include a back navigation item 216, a forward navigation item 218, and 
25 an up navigation item 220. In one embodiment, palette window 200D may also include a 
back navigation menu item 217, a forward navigation menu item 219, and an up 
navigation menu item 221. 

When navigating among a hierarchy of palette windows as illustrated in Figures 
5, 6, and 7, a user may generate a history of previously displayed windows. Figure 8A 
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illustrates using a back navigation item 216 to display a list 230A of, and optionally 
select from, previously displayed windows. Any of several methods may be used to 
display the list 230A. In one embodiment, the user may move cursor 226 over item 216 
and click-hold (e.g. hold down the mouse button) for a short period until the list 230A is 
5 displayed. In one embodiment, the user may select back navigation menu item 217 to 
display the list 230A, for example, by clicking on it. The user may open one of the palette 
windows in list 230A by selecting one of the items in list 23 OA. For example, the user 
might move the cursor over and click on "Graph" in the list 230A to display the "Graph" 
palette window 200B as illustrated in Figure 5C. 

10 In one embodiment, the windows in the list 230A may be shown in order from the 

most recently to the least recently previously displayed window. In other embodiments, 
other methods of ordering windows in list 230A may be used. Depending on the 
sequence of navigation that the user has previously performed, the palette windows in the 
list may or may not be in a hierarchical, parent-child arrangement, where the immediate 

15 parent of the currently displayed palette window is the most recently previously displayed 
palette window. In the example as illustrated in Figure 8A, "Picture" is the parent of 
"Datatypes", "Graph" is the parent of "Picture", and "Controls" is the parent of "Graph". 
If the user has previously navigated up and/or down other branches of the hierarchy or 
has used the search window 300 to "jump" to palette windows in other hierarchies or 

20 branches, then the palette windows may not be in a purely hierarchical arrangement in list 
230A. 

In one embodiment, the most recently previously displayed window in a 
backward direction may be displayed by selecting back navigation item 216 without 
displaying or selecting from a menu. In one embodiment, single-clicking on back 
25 navigation item 216 may select the back navigation item. In this example, selecting back 
navigation item 216 of palette window 200D may display the "Picture" palette window 
200C as illustrated in Figure 5E. 
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Figure 8B illustrates using an up navigation item 220 to display a list 230B of, 
and optionally select from, palette windows above the currently displayed palette window 
200D on this branch of the hierarchy of palette windows, and optionally up to the root 
(first) palette window in the hierarchy. Any of several methods may be used to display 
5 the list 23 OB. In one embodiment, the user may move cursor 226 over item 220 and 
click-hold (e.g. hold down the mouse button) for a short period until the list 230B is 
displayed. In one embodiment, the user may select up navigation menu item 221 to 
display the list 230B, for example, by clicking on it. The user may open one of the palette 
windows by selecting one of the items in list 230B. For example, the user might move 
10 the cursor over and click on "Controls" in the list 230B to display the "Controls" palette 
window 200A as illustrated in Figure 5A. The "Controls" palette window may be 
considered the root palette window in this hierarchy. Note that there may be other 
q hierarchies reachable through the search window or by opening other windows in the 

|S graphical programming application that display palette windows in the other hierarchies 

*B 15 when opened. 

m In one embodiment, the palette windows in the list 230B may be shown in order 

;« from the immediate parent palette window of the currently displayed palette window to 

£ _ the root palette window of this hierarchy. In other embodiments, other methods of 

m ordering palette windows in list 230B may be used. In the example as illustrated in 

;^ 20 Figure 8B, "Picture" is the parent of "Datatypes", "Graph" is the parent of "Picture", and 

O "Controls" is the parent of "Graph". 

In one embodiment, the parent palette window of the currently displayed palette 
window may be displayed by selecting up navigation item 220 without displaying or 
selecting from a menu. In one embodiment, single-clicking on up navigation item 220 
25 may select the up navigation item. In this example, selecting up navigation item 220 of 
palette window 200D may display the "Picture" palette window 200C as illustrated in 
Figure 5E, which is the parent palette window of palette window 200D. 



Figures 9A-9C - A second exemplary palette window with navigation items 
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Figures 9A-9C illustrate a second palette window 200E in an exemplary graphical 
programming environment with several navigation items for navigating among a 
hierarchy of palette windows according to one embodiment to highlight other aspects of 
using the navigation items. It is noted, however, that the various aspects of the present 
5 invention illustrated in this example may be applied to any computer-executable program 
or application that uses a hierarchy or hierarchies of palette windows. 

Palette window 200E as illustrated in Figures 9A-9C may include one or more 
navigation items for navigating among the hierarchy of palette windows, as well as for 
opening previously displayed windows in the program. The navigation items may be 
10 comprised in a navigation toolbar 214. The navigation items in this embodiment may 
include a back navigation item 216, a forward navigation item 218, and an up navigation 
item 220. In one embodiment, palette window 200E may also include a back navigation 
menu item 217, a forward navigation menu item 219, and an up navigation menu item 
221. 

15 When navigating among a hierarchy of palette windows as illustrated in Figures 

5, 6, and 7, a user may generate a history of previously displayed windows. Figure 9 A 
illustrates using a back navigation item 216 to display a list 230C of, and optionally select 
from, previously displayed palette windows and/or other windows. Any of several 
methods may be used to display the list 230C. In one embodiment, the user may select 

20 back navigation menu item 217 to display the list 230C, for example, by clicking on it. 
The user may then open a previously displayed window by selecting one of the items in 
list 230C. For example, the user might move the cursor over and click on "(search)" in 
the list 230C to display the search window 300 as illustrated in Figure 7A. As another 
example, the user might select "Datatypes" from list 230C to open the Datatypes palette 

25 window as illustrated in Figure 8 A. 

In one embodiment, the most recently previously displayed window in a 
backward direction may be displayed by selecting back navigation item 216 without 
displaying or selecting from a menu. In one embodiment, single-clicking on back 
navigation item 216 may select the back navigation item and thus display the most 
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recently previously displayed window. In this example, selecting back navigation item 
216 of palette window 200E may display the "Search" window 300 as illustrated in 
Figure 7A. 

5 Figure 9B illustrates using an up navigation item 220 to display a list 230D of, 

and optionally select from, palette windows above the currently displayed palette window 
200E on this branch of the hierarchy of palette windows, and optionally up to the root 
(first) palette window in the hierarchy. Any of several methods may be used to display 
the list 230D. In one embodiment, the user may select up navigation menu item 221 to 

10 display the list 230D, for example, by clicking on it. The user may display a palette 
window higher in the hierarchy than the current palette window by selecting one of the 
items in list 230D. For example, the user might move the cursor over and click on 
"Functions" in the list 230D to display the "Functions" palette window. In this example, 
the "Functions" palette window may be the root palette window in a hierarchy of palette 

15 windows for adding function elements to graphical programs. 

In one embodiment, the palette windows in the list 230D may be shown in order 
from the immediate parent palette window of the currently displayed palette window to 
the root palette window of this hierarchy. In other embodiments, other methods of 
ordering palette windows in list 230D may be used. In the example as illustrated in 

20 Figure 9B, "Functions" is the parent palette window of "Numeric". 

In one embodiment, the parent palette window of the currently displayed palette 
window may be displayed by selecting up navigation item 220 without displaying or 
selecting from a menu. In one embodiment, single-clicking on up navigation item 220 
may select the up navigation item. In this example, selecting up navigation item 220 of 

25 palette window 200E may display the "Functions" palette window, which is the parent 
palette window of palette window 200E. 

Figure 9C illustrates using a forward navigation item 218 of palette window 200 A 
to display a list 230E of, and optionally select from, previously displayed palette 
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windows in a forward direction. In this example, list 230E may have been generated 
using the back navigation item 216 of palette window 200E to back up through all 
previously displayed windows in list 230C of Figure 9A. In this case, selecting forward 
navigation item 218 of palette window 200A may display the "Graph" window 200B as 
5 illustrated in Figure 5C, which would be the most recently displayed window in a 
forward direction. 

Any of several methods may be used to display the list 230E. In one 
embodiment, the user may move cursor 226 over item 218 and click-hold (e.g. hold down 
the mouse button) for a short period until the list 230E is displayed. In one embodiment, 
10 the user may select forward navigation menu item 219 to display the list 230E, for 
example, by clicking on it. The user may open one of the palette windows by selecting 
one of the items in list 230E. For example, the user might move the cursor over and click 
on "Numeric" in the list 230E to display the "Numeric" palette window 200E as 
illustrated in Figure 9A. 

15 In one embodiment, the palette windows in the list 230E may be shown in order 

from the most recently to the least recently displayed palette window. In other 
embodiments, other methods of ordering palette windows in list 23 0E may be used. 
Depending on the sequence of navigation that the user has previously performed, the 
palette windows in the list may or may not be in a hierarchical, parent-child arrangement, 

20 where the immediate parent of the currently displayed palette window is the most 
recently previously displayed palette window. If the user has previously navigated up 
and/or down other branches of the hierarchy or has used the search window 300 to 
"jump" to palette windows in other hierarchies or branches, then the palette windows 
may not be in a purely hierarchical arrangement in list 230E. 

25 In one embodiment, the most recently previously displayed window in a forward 

direction may be displayed by selecting forward navigation item 218 without displaying 
or selecting from a menu. In one embodiment, single-clicking on forward navigation 
item 218 may select the forward navigation item and thus display the most recently 
previously displayed window in a forward direction. 
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Figure 10 - A hierarchical organization of palette windows 

Figure 10 shows an exemplary hierarchical organization of palette windows 
according to one embodiment. This example shows two hierarchies of palette windows 
5 in a graphical programming environment. It is noted, however, that the various aspects 
of the present invention illustrated in this example may be applied to any computer- 
executable program or application that uses one or more hierarchies of palette windows. 

The root of the first hierarchy is palette window 200A of Figure 5 A. The first 
hierarchy may include several palette windows for adding user interface elements to 
10 programs. The root of the firs hierarchy is palette window 200H. The second hierarchy 
may include several palette windows for adding function elements to programs. 

Each palette window in the hierarchy may have zero or more child palette 
O windows. For example, palette windows 200B and 200E are children of palette window 

200A, palette window 200J is a child of palette window 200H, and palette window 200D 
15 (among others) has no children. In one embodiment, a palette window may have at most 
\T\ one parent palette window. In another embodiment, a palette window may have more 

|ij than one parent palette window. 

Search window 300 may be accessed from palette windows in either the first or 
in second hierarchy. From there, the user may navigate directly to any palette window in 

jjf 20 either hierarchy. 

The following examples using the exemplary hierarchies of Figure 10 may be 
useful in distinguishing between the functionality of the back navigation item 216, the 
forward navigation item 218, and the up navigation item 220 as illustrated in Figures 9A- 
25 9C. A user may begin at root palette window 200A. Initially, all lists of palette 
windows displayed by navigation items may be empty. The user may open palette 
window 200B, then palette window 200C. At this point, the list of palette windows 
displayed by back navigation item 216 includes palette windows 200A and 200B, the list 
of palette windows displayed by forward navigation item 218 is empty, and the list of 
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palette windows displayed by up navigation item 218 includes palette windows 200A and 
200B. The user may use the back navigation item to back up to palette window 200B. 
At this point, the list of palette windows displayed by back navigation item 216 includes 
palette window 200A, the list of palette windows displayed by forward navigation item 
5 218 includes palette window 200C, and the list of palette windows displayed by up 
navigation item 218 includes palette window 200 A. The user may then use the back 
navigation item to back up to palette window 200A. At this point, the list of palette 
windows displayed by back navigation item 216 is empty, the list of palette windows 
displayed by forward navigation item 218 includes palette windows 200A and 200B, and 

10 the list of palette windows displayed by up navigation item 218 is empty, as this is the 
root of the first hierarchy. 

In one embodiment, if a user navigates up and down several branches, then the 
lists of palette windows displayed by navigation items may include palette windows from 
the different branches. For example, if the user next opened palette window 200E from 

15 palette window 200A, and then opened palette window 200F from palette window 200E, 
then the list of palette windows displayed by back navigation item 216 may include 
palette windows 200E, 200A, 200B, and 200C. If the user then used the back navigation 
item 216 to return to palette window 200C, then the list of palette windows displayed by 
forward navigation item 218 may include palette windows 200B, 200A, 200E, and 200F. 

20 

Multiple Navigation Mode Embodiment 

In one embodiment of the invention, the hierarchy of palette windows may have a 
plurality of different navigation modes, including the browser-based navigation mode 
described above with respect to Figures 5 A - 10 as well as the prior art "cascading' 
25 navigation mode described with respect to Figures 4 A - 4C. For example, in one 
embodiment the user may "left click" on a palette window selection item in the palette to 
perform a browser based method as described above with respect to Figures 5 A - 10, and 
may "right click" on a palette window selection item in the palette to perform a cascading 
type navigation as shown in Figures 4A - 4C. This allows the user the choice of selecting 
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which type of palette navigation method the user prefers. The user may also reprogram 
the left and right mouse buttons of his/her mouse to configure the preferred method for 
the left or right mouse button, per the user's preference. 

Figure 1 1 - Incorporating program elements from a search window 

Figure 1 1 illustrates an example of incorporating a located program element from 
a search window into a window of a program being edited according to one embodiment. 
In this example, a user may search for program elements including the search string 
"Recta" as entered in search field 302 of search window 300 as previously described for 
Figures 7A-7B. A list 306 of text entries or strings that may include palette window titles 
and program element names may be displayed in the search window 300. The user may 
select one or more program elements from the list to be incorporated into one or more 
windows 400 of a program currently being edited, for example, graphical user interface 
windows and block diagram windows. In this example, the user has selected the item 
"Labeled Rectangular Button" from the list and has incorporated a button of this type into 
a user interface window 400 of a program currently being edited. 

In one embodiment, a program element may be incorporated into the program by 
selecting the item in list 306 and "dragging and dropping" the item on a window of the 
program. Other methods of incorporating items from list 306 into programs may be used. 
For example, in one embodiment, a user may select an item in list 306 and a menu choice 
may then be selected to add the selected item to a window of the program. 

Figure 12 Searching for, locating and incorporating program elements 

Figure 12 is a flowchart of a method of searching for, locating and incorporating 
program elements according to one embodiment. As indicated at 500, a search window 
300 may be displayed on a computer display on which a program is being edited in a 
graphical programming system. In one embodiment, a user of the system may enter user 
input to cause the search window to be displayed. For example, a palette window may 
include a search item that the user may select to cause the search window to be displayed. 
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The user may then enter search criteria into the search window as indicated at 502. The 
system may then search for items indicated by the search criteria as indicated at 504. At 
506, located items may be displayed. These located items may include one or more items 
related to program elements that may be incorporated in the program being edited to add 
5 functionality to the program. In one embodiment, the items may be displayed in the 
search window, for example, in a list of located elements as illustrated in Figure 1 1 . 
Optionally, the located items may be displayed in a different window. 

The user may then select one or more located program elements and incorporate 
the one or more program elements in one or more windows of the program being edited 

10 as indicated at 508. In one embodiment, a program element may be incorporated into the 
program by selecting the item in list 306 and "dragging and dropping" the item on a 
window of the program. Other methods of incorporating items from list 306 into 
programs may be used. For example, in one embodiment, a user may select an item in 
list 306 and a menu choice may then be selected to add the selected item to a window of 

15 the program. Thus, the search results displayed in the search window may include 
program elements that can be selected and incorporated, such as through a drag and drop 
method, directly from the search window into a window of the program being edited, in a 
similar manner to which a palette item (representing a program element) may be selected 
from its respective palette window and incorporated in a window of the program being 

20 edited. 



Various embodiments may further include receiving, sending or storing 
instructions and/or data implemented in accordance with the foregoing description upon a 
25 carrier medium. Generally speaking, a carrier medium may include storage media or 
memory media such as magnetic or optical media, e.g., disk or CD-ROM, volatile or non- 
volatile media such as RAM (e.g. SDRAM, RDRAM, SRAM, etc.), ROM, etc. as well as 
transmission media or signals such as electrical, electromagnetic, or digital signals, 
conveyed via a communication medium such as network and/or a wireless link. 
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Although the system and method of the present invention has been described in 
connection with the preferred embodiment, it is not intended to be limited to the specific 
form set forth herein, but on the contrary, it is intended to cover such alternatives, 
modifications, and equivalents, as can be reasonably included within the spirit and scope 
of the invention as defined by the appended claims. 
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